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T/ie MAIUNG DATE of this communication appears on the cover sheet with the correspondence address -- 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent terni adjustment. See 37 CFR 1 .704(b). 

Status 

1 )S Responsive to communication(s) filed on 21 December 2001 . 
2a)n This action is FINAL. 2b)[EI This action is non-final. 

3) 0 Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1 935 CD; 1 1 , 453 O.G. 213, 

Disposition of Claims 

4) KI Claim(s) 1-28 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) 0 Claim(s) is/are allowed. 

6) KI Claim(s) 1-28 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) 0 Claim(s) ^ are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10)0 The drawing(s) filed on is/are: a)0 accepted or b)0 objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held In abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
11 )D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)DAII b)0 Some * c)D None of: 

1 .Q Certified copies of the priority documents have been received. 

2.D Certified copies of the priority documents have been received in Application No. , . 



3.Q Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 

1 . This action is responsive to application filed 12/21/2001 . 

2. Claims 1-28 are pending. Claims 1, 8, 13. 19, 24 and 25 are independent claims. 

3. If a copy of a provisional application listed on the bottom portion of the 
accompanying Notice of References Cited (PTO-892) form is not included with this 
Office action and the PTO-892 has been annotated to indicate that the copy was not 
readily available, it is because the copy could not be readily obtained when the Office 
action was mailed. Should applicant desire a copy of such a provisional application, 
applicant should promptly request the copy from the Office of Public Records (OPR) in 
accordance with 37 CFR 1.14(a)(1)(iv), paying the required fee under 37 CFR 

1 .19(b)(1 ), If a copy is ordered from OPR, the shortened statutory period for reply to 
this Office action will not be reset under MPEP § 710.06 unless applicant can 
demonstrate a substantial delay by the Office in fulfilling the order for the copy of the 
provisional application. Where the applicant has been notified on the PTO-892 that a 
copy of the provisional application is not readily available, the provision of MPEP 
§ 707.05(a) that a copy of the cited reference will be automatically furnished without 
charge does not apply. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed 
or described as set forth in section 1 02 of this title, if the differences between the 
subject matter sought to be patented and the prior art are such that the subject 
matter as a whole would have been obvious at the time the invention was made 
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to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was 
made. 

5. Claims 1-28 are rejected under 35 U.S.C. 103(a) as being unpatentable by 
Schneiderman US Pub No. 2002/0054059 A1 issued 05/09/2002 filed 10/15/2001 
(hereinafter '059), in view of Omoigui US Pub No. 2003/0126136 A1 issued 
007/03/2003 filed 06/24/2002 Provisional No. 60/300,385 filed 06/22/2001 
(hereinafter '136). 

In regard to independent claim 1, "providing an image on said display; and 
identifying via an identifier on said display a status of said image. . as taught by '059 
at page 2, paragraphs [0011] though [0012] (i.e.... display desired electronic images 
or groups or collections of such images. The annotations may be text, images, logos, 
web pages, web links, sounds, etc.... a scrolling list of annotations (such as personal 
names, dates, objects, events, etc.) to be displayed in response to a user action. The 
user may then access a desired annotation...). 

*059 does not explicitly teach, "said identifier being viewable only during a 
predetermined time criteria time", however, as taught by '136 at page 64, paragraph 
[1^166] (i.e.... "Timeline" Context Palette ...The timeline may contain information items 
based on their publish/post time, event items based on their appointment time, etc ...). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to have modified '136 into '059 to provide a way to include the 
feature, wherein identifier of a display status of an image being viewable only during a 
predetermined time criteria time. One of ordinary skill in the art would have been 
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motivated to perform such a modification to provides multiple client access of 
communication between diverse knowledge information sources via an independent 
Semantic Web platform or via a Web access browser that enable programmatic 
integration, that delivering requested semantic information based upon user queries 
and presenting semantic information according to customizable user preferences that 
allow end users to view a time-sensitive multimedia presentation, and various useful 
features (e.g. semantic web automatic/intelligent/dynamic linking), as taught in '136 at 
page 3, paragraph [0027] thought [0032] (i.e.... time-sensitivity...). 

In regard to dependent claim 2, ''wherein a status comprises one of a new 
image, an altered image, and a current image", as taught by '059 at page 6, paragraph 
[0061] (i.e.... Relationship Between Collections and Images. ...). 

In regard to dependent claim 3, ''predetermined time criteria is a maximum 
lime limit", as taught by '136 at page 63, paragraph [01 52] (i.e.... without any filter for 
the number of objects to be displayed or the "freshness" time limit...). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to have modified '136 into *059 to provide a way to include the 
feature, wherein identifier of a display status of an image being viewable only during a 
limit time. One of ordinary skill in the art would have been motivated to perform such a 
modification to provides multiple client access of communication between diverse 
knowledge information sources via an independent Semantic Web platform or via a 
Web access browser that enable programmatic integration, that delivering requested 
semantic information based upon user queries and presenting semantic information 
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according to customizable user preferences that allow end users to view a time- 
sensitive multimedia presentation, and various useful features (e.g. semantic web 
automatic/intelligent/dynamic linking), as taught in '136 at page 3, paragraph [0027] 
thought [0032] (i.e.... time-sensitivity...). 

In regard to dependent claim 4, "wherein said providing an image step 
comprises loading a Webpage including said image", as taught by '059 at page 2, 
paragraph [0011] (i.e.... display desired electronic images ... such images ... web 
pages, web links, sounds, etc, ...). 

In regard to dependent claim 5, "embedding a link to said identifief\ as taught 
by '059 at page 4, paragraph [0047] (i.e.... The term "annotation" the association of 
text (including a textual hyperlink) to an image aspect of an image, such that the image 
aspect can be retrieved, collected, displayed or distributed using the annotation...). 

In regard to dependent claim 6, "the step of removing said embedded link 
after said predetermined time criteria", as taught by '1 36 at page 32, paragraph [0622] 
(i.e.... allowed to remove semantic links. Decision Agents (described below) use the 
Inference Engine to assist knowledge-workers in making decisions...). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to have modified '136 into '059 to provide a way to include the 
feature, wherein the embedded link of identifier display status of an image can be 
removed after a predetermined time. One of ordinary skill in the art would have been 
motivated to perform such a modification to provides multiple client access of 
communication between diverse knowledge information sources via an independent 
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Semantic Web platform or via a Web access browser that enable programmatic 
integration, that delivering requested semantic information based upon user queries 
and presenting semantic information according to customizable user preferences that 
allow end users to view a time-sensitive multimedia presentation, and various useful 
features (e.g. semantic web automatic/intelligent/dynamic linking), as taught in '136 at 
page 3, paragraph [0027] thought [0032] (i.e.... time-sensitivity...). 

In regard to dependent claim 7, ''embedding a link to said identifier is 
performed automatically whenever the status of said image changes", as taught by 
'059 at page 6, paragraph [0073] (i.e.... automatically calculates the Person ID of the 
selected name label and the PhotolD, and it searches through the Appearance Table 
to find and delete an Appearance record having those IDs. The software of the present 
invention updates "People in this Photograph" listbox and deletes the name label on 
the photograph...). 

In regard to independent claim 8, incorporate substantially similar subject 
matter as cited in claims 1 , and 5-6 above, and is similarly rejected along the same 
rationale. 

In regard to dependent claim 9, "wherein a status comprises one of a new 
image, an altered image, and a current image", as taught by '059 at page 6, paragraph 
[0061] (i.e.... Relationship Between Collections and Images. ...). 

In regard to dependent claim 10, ''wherein said display comprises a 
Webpage\ as taught by '059 at page 2, paragraph [001 1] (i.e.... display desired 
electronic images ... such images ... web pages, web links, sounds, etc. ...). 
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In regard to dependent claim 11, "The method of claim 8, wherein said time 
criteria is a maximum lime limit", as taught by '136 at page 63, paragraph [0152] 
(i.e.... without any filter for the number of objects to be displayed or the "freshness" 
time limit...). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to have modified '136 into '059 to provide a way to include the 
feature, wherein identifier of a display status of an image being viewable only during a 
limit time. One of ordinary skill in the art would have been motivated to perform such a 
modification to provides multiple client access of communication between diverse 
knowledge information sources via an independent Semantic Web platform or via a 
Web access browser that enable programmatic integration, that delivering requested 
semantic information based upon user queries and presenting sennantic information 
according to customizable user preferences that allow end users to view a time- 
sensitive multimedia presentation, and various useful features (e.g. semantic web 
automatic/intelligent/dynamic linking), as taught in '136 at page 3, paragraph [0027] 
thought [0032] (i.e.... time-sensitivity...). 

In regard to dependent claim 12, ''wherein the step of relating a time criteria to 
said image and the step of embedding a link to an identifier are both performed 
automatically when a new or altered image is generated', as taught by '059 at page 6, 
paragraph [0073] (i.e.... automatically calculates the PersonID of the selected name 
label and the PhotolD, and it searches through the Appearance Table to find and 
delete an Appearance record having those IDs. The software of the present invention 
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updates "People in this Photograph" listbox and deletes the name label on the 
photograph...). 

In regard to independent claim 13, is directed to a machine for performing the 
method of claim 1 and is similarly rejected along the same rationale. 

In regard to dependent claims 14-18 consecutively, is directed to a machine 
for performing the method of claims 2-6 consecutively, and are sinnilarly rejected along 
the same rationale. 

In regard to independent claim 19, is directed to a machine for performing the 
method of claim 8 and is similarly rejected along the same rationale. 

In regard to dependent claims 20-23 consecutively, is directed to a machine 
for performing the method of claims 9-12 consecutively, and are similarly rejected 
along the same rationale. 

In regard to Independent claim 24, is directed to a machine for performing the 
method of claims 2-4 and is similarly rejected along the same rationale. 

In regard to independent claim 25, is directed to a device for performing the 
method of claim 8 and is similarly rejected along the same rationale. 

In regard to dependent claim 26, is directed to a device for performing the 
method of claim 8 and is similarly rejected along the same rationale. 

In regard to independent claim 27, is directed to a device for performing the 
method of claim 1 1 and is similarly rejected along the same rationale. 

In regard to dependent claim 28, "wherein said time criteria is a tiit count", as 
taught by '136 at page 2, paragraph [0013] (i.e.... resulting medium for knowledge 
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retrieval, management and delivery. A non-exhaustive list of these properties include: 
Semantics/Meaning; Context-Sensitivity; Time-Sensitivity; Automatic and intelligent 
Discoverability; Dynamic Linking; User-Controlled Navigation and Browsing; Non-HTML 
and Local Document Participation in the Network; Flexible Presentation that Smartly 
Conveys the Semantics of the Information being Displayed; Logic, Inference, and 
Reasoning; Flexible User-Driven Information Analysis; Flexible Semantic Queries; 
Annotations...). Examiner reads resulting list ... Flexible Semantic Queries, which could 
be interpreted as the claimed "hit count. 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to have modified '136 into '059 to provide a way to include the 
feature, wherein identifier of a display status of an image being viewable relating to 
time criteria, which could be a hit count. One of ordinary skill in the art would have 
been motivated to perform such a modification to provides multiple client access of 
communication between diverse knowledge information sources via an independent 
Semantic Web platform or via a Web access browser that enable programmatic 
integration, that delivering requested semantic information based upon user queries 
and presenting semantic information according to customizable user preferences that 
allow end users to view a time-sensitive multimedia presentation, and various useful 
features (e.g. semantic web automatic/intelligent/dynamic linking), as taught in '136 at 
page 3, paragraph [0027] thought [0032] (i.e.... time-sensitivity...). 
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Conclusion 



6. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Escobar et a! USPAT- 5,826,102 issued 10/20/1998 filed 09/23/1996 
Boezeman et al USPAT- 5,758,093 issued05/26/1998 filed 03/29/1996 

7. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Quoc A. Tran whose telephone number is (703) 305- 
8781 , "After Oct 20, 2004, the examiner can be reach at (571) 272- 4103". The 
examiner can normally be reached on Monday through Friday from 8:30AM to 5:30PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Joseph H. Feild can be reached on (703) 305-9792, The fax phone number 
for the organization where this application or proceeding is assigned is (703) 872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 

For more information about the PAIR system, see http://pair-direct.uspto.gov. 
Should you have questions on access to the Private PAIR system, contact the 
Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
Quoc A, Tran 

Patent Examiner yyY /// 
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